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Abstract 

We  consider  the  problem  in  risk  assessment  of  evaluating  the 
probability  of  occurrence  of  rare,  but  potentially  catastrophic, 
events.  The  lack  of  historical  data  due  to  the  sheer  novelty  of 
the  event  makes  conventional  statistical  approaches  inappropriate. 

The  problem  is  compounded  by  the  complex  multivariate  dependencies 
that  may  exist  across  potential  event  sites.  In  order  to  evaluate 
the  likelihood  of  one  or  more  such  catastrophic  events  occuring,  we 
provide  an  information  theoretic  model  for  merging  a  decision  maker's 
opinion  with  expert  judgment.  Also  provided  is  a  methodology  for 
the  reconciling  of  conflicting  expert  judgments.  This  merging  approach 
is  invariant  to  the  decision  maker's  viewpoint  in  the  limiting  case 
of  exceptionally  rare  events.  These  methods  are  applied  to  case 
studies  in  likelihood  assessment  of  Liquid  Natural  Gas  tanker  spills 
and  seismic  induced  light  water  nuclear  reactor  meltdowns. 

KEY  WORDS:  risk  assessment,  information  theory,  merging  opinions, 

rare  events,  Frdch^t  bounds,  LNG  tanker  spills,  nuclear  reactor 
safety. 
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Assessing  Risks  Through  the  Determination  of 
Rare  Event  Probabilities 
by 

Allan  R.  Sampson*  and  Robert  L.  Smith 
1.  INTRODUCTION 

In  an  increasingly  complex  and  technological  world,  method¬ 
ologies  for  dealing  with  risk  assessment  have  taken  on  new  impor¬ 
tance.  The  scale  and  power  of  technology  have  created  the 
potentiality  for  the  occurrence  of  truly  catastrophic  events.  These 
include,  but  are  not  limited  to,  LNG  (liquid  natural  gas)  tanker 
explosions,  serious  nuclear  reactor  accidents,  recombinant  DNA 
accidents,  and  nuclear  weapons  accidents.  Nevertheless,  the  more 
remote  the  likelihood  of  such  an  occurrence,  the  less  apprehensive 
we  are,  until  some  threshold  probability  PT  is  reached  below  which 
we  become  indifferent.  This  threshold  value  of  course  depends 
heavily  on  the  seriousness  of  the  consequences  were  the  event  to 
occur.  Risk  assessment  therefore  can  be  viewed  as  a  two- fold  process 
comprising  i)  the  assessment  of  the  likelihood  of  an  undesircable 
event  occurring  (risk  determination,  see  Rowe  (1977)),  and  ii)  the 
valuation  of  the  consequences  to  the  risk  taker  were  that  event  to 
occu*-  (risk  evaluation,  see  Rowe).  Our  focus  in  this  paper  is  on 
the  first  problem  of  risk  determination. 

Risk  determination  is  a  particularly  difficult  task  because  of 
the  sheer  novelty  of  the  event  of  concern.  Doing  catastrophic,  it 
is  almost  certainly  a  rare  event,  and  moreover  may  never  have  histor¬ 
ically  occurred.  This  lack  of  historical  statistical  data  makes  it 

♦The  work  of  this  author  is  sponsored  in  part  by  the  Office  of  Scien¬ 
tific  Research,  Air  Force  Systems  Command  under  contract  F49620-79- 
-C-0161.  Reproduction  in  whole  or  in  part  is  permitted  for  anv  pur¬ 
poses  of  the  United  States  Government. 
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difficult,  if  not  impossible,  to  use  conventional  data  analysis  to 
assess  the  likelihood  of  the  event's  occurrence.  Wo  are  in  a  situa¬ 
tion  of  formulating  a  probability  model,  where  the  model  must  be 
based  on  limited  structural  information.  Concerning  these  concepts 
in  assessing  nuclear  reactor  safety,  Lewis  (1980)  writes  that 

"a  reactor  accident  with  public  consequences  is  demon¬ 
strably  an  extremely  improbable  event  for  which  there  is 
no  actuarial  record.  When  any  event,  such  as  a  putative 
reactor  accident,  has  a  very  low  probability,  but  poten¬ 
tially  severe  consequences,  it  means  that  safety  analysis 
must  be  based  on  theoretical  calculations  rather  than  on 
experience  and  this  leads  to  special  problems." 

The  decision  maker  (who  must  ultimately  make  the  determination  as 
to  how  "safe"  the  relevant  technology  or  system  is)  is  prototypically 
confronted  with  probability  judgments  from  one  or  more  experts,  often 
in  conflict  with  his  own  personal  assessment  as  well  as  with  each 
other.  The  term  "experts"  is  used  genorically  to  denote  individuals, 
commissions,  study  groups,  etc.  The  decision  maker's  task  is  to 
reconcile  the  conflicts  and  merge  the  opinions  in  a  responsible  and 
consistent  fashion.  The  probability  assessment  (or  range  of  assess¬ 
ments)  thus  synthesized  may  be  compared  with  the  threshold  proba¬ 
bility  value  and  a  decision  may  be  reached  as  to  whether  or  not 
action  is  warranted. 

We  propose  in  this  paper  a  methodology  that^will  provide  for 
a  consistent  merging  of  the  decision  maker's  opinions  with  expert 
judgments  as  to  the  event's  likelihood.  We  show  that  for  rare 
events,  the  model  provides  for  1 —  order  agreement  as  to  the  event's 
likelihood  no  matter  what  the  initial  views  of  the  decision  maker. 
Further,  the  model  leads  to  a  sensible  procedure  for  reconciling, 
merging,  and  updating  differing  expert  judgments. 
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Consider  now  two  case  studies  in  risk  assessment.  The  first 
case  will  later  illustrate  the  merging  of  a  decision  maker’s  view¬ 
point  with  expert  judgment,  and  the  second  will  illustrate  the 
model's  procedure  for  reconciling  differing  expert  opinions. 

Case  Study  1  (LNG  Tanker  Movement) 

The  possibility  of  a  large  spill  of  LNG  (Liquid  Natural  Gas) 
in  a  harbor  due  to  a  tanker  collision  is  a  potential  hazard  of 
considerable  concern.  It  is  widely  held  that  such  an  occurrence 
could  result  in  a  catastrophic  conflagration  whose  consequences  are 
of  the  same  order  of  magnitude  in  lives  and  property  as  a  major 
accident  at  a  nuclear  power  plant.  It  is  therefore  essential  to 
obtain  estimates  of  the  likelihood  of  such  an  event  occuring. 

In  1974,  the  Federal  Power  Commission  requested  a  report  by 
independent  consultants  as  to  the  risk  posed  by  proposed  LNG  Tanker 
movement  in  the  New  York  harbor.  Table  1  (taken  from  Fairley  (1977)) 
represents  a  summary  of  the  central  findings  of  that  report.  The 
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report  generated  two  summary  figures.  The  p  =  ^^■<3ure 

represents  the  probability  that  an  undesireable  LNG  event  occurs  on 
a  single  (typical)  trip.  The  number  is  clearly  an  average  proba¬ 
bility  over  the  various  trips  one  could  expect  over  the  10  year 
horizon  time.  The  Commission  interpreted  the  v>  =  figure  as 

the  probability  of  at  least  one  undesireable  LNG  event  over  the  10 
year  horizon.  In  fact,  this  figure  is  the  expected  number  of  such 
events  and  only  corresponds  to  the  approximate  probability  of  such 
an  event  when  the  number  of  such  events  follows  a  Poisson  probability 
law.  No  justification  is  apparent  for  such  an  assumption.  The 
risk  probability  of  was  deemed  by  the  Federal  Power  Commission 

as  low  enough  so  that  the  proposed  LNG  tanker  and  barge  movement 
posed  an  acceptable  risk. 

Case  Study  2:  (Seismic  Safety  of  Nuclear  Reactors) 

There  are  approximately  100  light  water  nuclear  reactors  cur¬ 
rently  operational  around  the  United  States.  One  of  the  environ¬ 
mental  hazards  potentially  leading  to  a  core  meltdown  is  severe 
seismic  activity  (earthquakes  exceeding  0.2g  ground  acceleration) . 

In  1974,  the  U.S.  Nuclear  Regulatory  Commission  commissioned  a  study 
to  quantitatively  assess  nuclear  reactor  risks;  this  included  study¬ 
ing  the  effects  of  earthquakes.  The  report  generated  by  that  study 
is  known  as  WASH — 1400  or,  more  informally,  the  Rasmussen  report  (see 
U.S.  Nuclear  Regulatory  Commission  (1975)).  The  NRC  concluded  that 
earthquake  risk  was  negligibly  small  compared  to  other  reactor  acci¬ 
dent  risks.  Table  2  summarizes  the  data  and  analysis  that  supported 
this  conclusion. 


Three  levels  of  earthquake  severity  were  considered  and  the 
resulting  overall  probability  p  of  core  meltdown  over  a  given  year 


Table  2.  Summary  of  U.S.  NRC  Report  on  Probability  of  Core 
Melt  Due  to  Earthquake  for  an  Average  Site  in  the  Eastern  U.S. 
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at  an  average  (typical)  site  was  computed.  The  figure  arrived  at 
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by  the  Commission  was  p  =  4.7  x  10  .  A  project  sponsored  by  the 

National  Science  Foundation  and  under  the  Directorship  of  David 
Okrent  (1977,  Chapter  9)  considered  the  same  problem  and  arrived 
at  an  alternative  probability  of  p1  =  8  x  10  (assuming  minimal 
or  no  reactor  design  errors) .  This  project  study  differed  primarily 
in  its  explicit  consideration  of  alternative  failure  modes  leading 
to  core  meltdown.  This  represents  a  particularly  vexing  situation 
for  the  decision  maker  who  must  decide  whether  or  not  the  risk  is 
acceptable  when  confronted  by  conflicting  expert  opinion.  The  ques¬ 
tion  arises  as  how  to  "average"  the  two  judgments  for  p.  Moreover, 
how  does  the  decision  maker  include  his  personal  viewpoint  into  the 
reconcilation  process? 

A  number  of  issues  concerning  risk  assessment  are  considered  in 
this  paper.  In  Section  2,  the  general  probabilistic  structure  for 
evaluating  site  dependencies  is  discussed.  An  information  theoretic 
model  is  introduced  in  Section  3;  and  in  Section  4,  this  model  is  used 
for  reconciling  and  updating  several  expert  judgments.  A  brief 
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discussion  of  some  computational  aspects  is  given  in  Section  5. 
Applications  of  these  results  to  the  two  Case  Studies  are  considered 
throughout.  Proofs  and  certain  technical  material  can  be  found  in 
Appendices  A,  B,  C  and  D. 

2.  RISK  DETERMINATION  WITH  SITE  DEPENDENCIES 

2 . 1  Relating  Risk  Determination  to  Site  Occurrences 

In  this  section,  we  consider  a  general  model  applicable  for  a 
wide  variety  of  risk  determination  problems. 

Suppose  we  are  interested  in  assessing  the  likelihood  of  an 
event  E  which  may  or  may  not  occur  at  one  or  more  of  M  sites.  Site 
is  here  a  generic  term  that  may  refer  to  components  within  a  sub¬ 
system,  or  subsystems  within  a  system,  or  literally  geographical 
site  locations  for  facilities.  It  is  assumed  that  E  is  sufficiently 
rare  that  the  possibility  of  two  or  more  occurrences  at  a  single 
site  over  the  horizon  time  of  interest  can  be  effectively  ignored. 
Let  Vj  =  1,  or  0,  according  to  whether,  or  not,  E  occurs  at  site  j, 
that  4*^,  ...,  4^  constitute  a  complete  specification  of  the  outcome 
of  the  event  process.  The  event  E  is  regarded  as  catastrophic  were 
it  to  occur  even  once;  therefore,  our  attention  is  directed  to  the 
random  variable  X  denoting  the  number  of  occurrences  of  E.  Our 

interest  is  in  obtaining  the  probability  P  of  a  catastrophic  event, 

M 

where  P  =  P(X  _>  1).  Note  that  X  =  T.  V  . .  Since  X  can  be  expressed 
c  j=l  3 

in  terms  of  4^,  ...,  4*  ,  Pc  is  readily  obtainable  once  the  multi¬ 
variate  distribution  of  'F,,  ...,  4',.  is  known.  If  lF.  ,  ...,  4'.,  were 
independent,  they  would  constitute  so-called  Poisson  trials  (Feller 
(1968,  p.  218)  )  and  it  is  not  difficult  to  show  that  Pc  >_  1  -  e  11 , 


so 
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M 

where  y  =  Z  v  .  is  the  expected  number  of  occurrences  of  E  over  the 
j  =  l  ^ 

M  sites  and  « ^  =  P(4*j  =  1)  is  the  probability  of  an  occurrence  of  E 
at  site  j,  j  =  1,  . . . ,  M.  Moreover,  for  fixed  y  (see  Feller  (1968, 

p.  282)) 

(2.1)  lim  P  =  1  -  e“u  . 

M-*oo 

Equation  (2.1),  therefore,  gives  Pc  in  terms  of  the  expected  number 
of  occurrences  of  E,  when  E  is  rare,  the  number  of  sites  is  large, 
and  the  occurrences  are  independent  across  sites. 

Unfortunately,  the  site  independence  assumption  is  in  most  cases 
not  warranted.  Commonality  of  components,  facility  design,  and 
operational  procedures  introduces  significant  dependencies  across 
sites  that  can  not  be  disregarded.  In  short,  4>2,  ...,  ^  are 

typically  dependent  random  variables.  (See  Appendix  A  for  a  tech¬ 
nical  discussion  of  this  point.)  In  this  case,  tt2»  .  itm 

do  not  uniquely  define  the  multivariate  distribution  of  4^,  .  .., 

4^.  One  must  in  fact  specify  the  probabilities  for  all  possible 

values  that  4'.,  ...,  4*  may  jointly  assume,  i.e.,  for  all  binary 
i  M 

M-vectors.  For  example,  for  M  =  100  light  water  reactor  sites,  the 
number  of  distinct  probability  values  required  is  2^®.  Clearly, 
the  task  of  specifying  a  multivariate  distribution  for  4^,  ...,  4'^ 
is  impractical  in  the  absence  of  underlying  structural  models  for 
the  dependencies  involved.  However,  modeling  dependency  in  complex 
environments  such  as  the  ones  being  considered  is  currently  beyond 
the  state  of  the  art.  On  the  other  hand,  obtaining  reliable  judg¬ 
ments  concerning  each  of  the  marginal  distributions  of  the  4'^,  or 
equivalently,  of  the  is  certainly  reasonable.  (Event  tree  and 


fault  tree  analysis  are  very  effective  tools  in  this  regard.  See 
Barlow  and  Proschan  (1975,  pp.  255-274)  for  a  thorough  discussion 
of  these  techniques.) 


2 . 2  Risk  Probability  Bounds  and  Expert  Judgment 

Specification  of  the  marginal  probabilities  ir^,  ...,  it 

constrains  the  multivariate  probability  distribution  over  , 

.  ..,  and,  therefore,  limits  the  possible  multivariate  distribu¬ 
tions.  These  constraints  in  turn  give  rise  to  a  range  of  possible 
values  of  P  .  If  this  interval  covers  the  indifference  probability, 
there  is  uncertainty  as  to  whether  or  not  the  potential  for  cata¬ 
strophe  should  be  of  concern.  If,  however,  the  interval  lies 
entirely  below  the  critical  value  or  entirely  above  the  critical 
value,  then  we  have  an  unequivocal  answer  as  to  where  the  actual 
probability  of  catastrophe  P  lies  relative  to  the  threshold  proba¬ 
bility  PT. 

Given  ir.,  ir_,  ...,  ir,  ,  upper  and  lower  bounds  for  P  can  be 
i  Z  M  c 

derived  from  the  multivariate  Frechet-Hoef fding  bounds  for  multi¬ 
variate  c.d.f.'s  (e.g.,  Dall'Aglio  (1972)).  (See  Appendix  A  for 
the  derivation.)  These  bounds  are 

M 

(2.2)  max  u.  <  P  <  min(  l  tt.,1). 

l<i<M  1  C  i=l  1 

M 

For  E  t.  <  1,  these  bounds  are  attainable,  i.e.,  there  exist  actual 
i=l  1 

site  dependencies  with  the  noted  marginal  probabilities  giving  rise 

to  each  P  in  the  interval  of  (2.2) .  Note  that  not  all  of  the  infor- 
c 

mation  in  the  values  it^,  it  ,  ...,  it  is  utilized  in  constructing 
these  upper  and  lower  bounds.  In  particular,  we  need  to  know  only 
their  sum  and  their  largest  value. 
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Now  suppose  that  we  wish  to  construct  bounds  for  P  ,  where  the 

only  information  available  concerning  the  marginal  probabilities 

-1  M 

is  that  we  are  given  p  =  M  E  tt  .  ,  which  is  the  site  average  proba- 

i=l 

bility  of  E  occurring  at  a  typical  (randomly  selected)  site.  Among 

M 

the  class  of  all  multivariate  c.d.f.'s  with  E  Prob(y.  =  1)  =  Mp  , 

i=l  1 

the  following  tight  bounds  can  be  obtained  for  P 

c 

(2.3)  P  <  P  <  M  p  . 

—  c  —  * 


Note  that  the  upper  bounds  of  (2.2)  and  (2.3)  are  the  same  while 

the  lower  bounds  differ.  Usually,  it  is  the  upper  bound  on  P^  that 

is  of  interest,  the  expectation  being  that  this  upper  bound  will  be 

below  the  threshold  probability;  in  this  situation  tr^,  ..., 

-1  M 

provide  no  additional  information  beyond  that  provided  by  M  .  v.  .  . 

i-1 

Equation  (2.3)  requires  a  valuation  of  p,  the  probability  that 
E  occurs  at  a  typical  site,  and  M,  the  number  of  sites.  This  form 
of  expert  judgment  as  model  input  is  natural  and  quite  mini¬ 
mal  in  its  demands  on  the  expert.  For  example,  Lewis  notes  that 
the  Rasmussen  report  concerning  light  water  reactor  safety  focused 
on  "one  typical  ...  reactor."  Again  note  that  it  is  not  necessary 

to  know  anything  about  the  possible  dependencies  over  the  sites  to 

-1  M 

specify  p  and  M,  since  p  =  M  E  tt  .  is  only  a  function  of  the  marginal 

i=l  1 

distributions  over  the  sites.  It  will  later  be  useful  for  technical 

reasons  to  have  the  expert  judgment  re-expressed  in  terms  of  u  =  EX, 

the  mean  number  of  occurrences  of  E  over  all  sites.  Note  that 

M  M  M  M 

U  =  E  Z  V  .  =  I  ET.  *  Z  P(f.  =  1)  =  E  ir.  =  Mp 

j  =  1  j  =  1  ^  j  =  l  ^  j  =  l  ^ 

regardless  of  the  multivariate  distribution  of  ...»  VM.  Hence, 

(2.3)  may  be  rewritten  in  terms  of  y,  without  imposing  any  additional 
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assumptions,  as  the  following 

(2.4)  M_1y  <  Pc  <  u  . 

Accordingly,  a  specification  of  the  value  of  y  will  formally  be 
referred  to  hereafter  as  the  expert  judgment.  Also,  because  the 
upper  bound  in  (2.4)  is  informative  only  when  u  <  1,  we  will  define 
E  as  a  rare  event  whenever  y  <  1,  i.e.,  whenever  expert  judgment  is 
that  it  is  "not  expected  to  occur." 

Equation  (2.4)  expresses  the  range  of  possible  probabilities 
Pc  consistent  with  a  given  specification  for  y.  Of  course,  there 
may  be  considerable  uncertainty  surrounding  the  valuation  of 
p  and  hence  y.  It  is  useful,  therefore,  to  invert  (2.4)  to  find 
what  range  of  values  of  y  lead  to  Pc  >_  PT  and  ?c  PT,  respectively. 
The  corresponding  lower  and  upper  bounds  for  y  are  given  by  the 
following  relations 


(2.5) 


p  > 

c  — 

PT 

if 

y  >  y(PT) 

=  M  P 

P  < 
c  — 

P 

T 

if 

y  <  y(P  ) 
_  -  T 

=  P 

T 

Alternatively,  one  may  ask  what  range  of  values  of  y  is  consistent 
(in  the  sense  of  satisfying  (2.4))  with  a  given  value  for  P  .  It 

follows  directly  from  (2.5)  that  the  interval  of  consistent  values 
of  y  is 


(2.6) 


y (P_)  <  y  <  y (P  )  . 

“  w  C 


The  bounds  of  equation  (2.6)  may  be  viewed  as  providing  a  sensitivity 
analysis  for  Pc  in  terms  of  allowable  values  of  y.  In  other  words, 
as  long  as  the  perceived  uncertainty  in  the  true  value  of  y  lies 
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within  the  bounds  given  by  (2.6),  there  is  no  logical  inconsistency 
in  adopting  the  value  Pc  as  the  probability  of  catastrophe. 

2 . 3  Consistency  Analysis  for  LNG  Tanker  Movements 

In  a  critique  of  the  study  concerning  the  safety  of  LNG  tanker 
movements,  Fairley  (1977)  notes  that  the  probabilities  of  most 
factors  could  possibly  be  upwardly  corrected.  The  upward  correc¬ 
tions  are  summarized  in  the  following  table  taken  from  Fairley  (1974, 
p.  344). 


Table  3.  Possible  Correction  Factors  for 
LNG  Tanker  Movement  Probabilities 


Factor  Symbol 

Source  of  error 
or  uncertainty 
in  estimate 

Possible  upward  cor¬ 
rection  factor  for 
estimate  (Multiply  ! 

timer,  original  esti¬ 
mated  probabilities 
in  Table  1). 

B 

Reporting  error 

2-5 

Extrapolation  to 
LNG  ves re1 s 

2-5 

C 

Spoon  1 o  f i vol V 

based  ost? iv*. he 

5 

D 

Unpnbrtnnhi  a'-ed 
theory 

2  + 

i 

E 

Drf:  n?  J;  i  onpl 

error 

1.5  ! 

i 

G 

Specula  t.i  vo  1  y 

J  v* rod  o r f  i  rv  to 

5  i 

The  use  of  these  correcti  on  factors  (multipliers  of  16  and  2  were 

used  for  factors  B  and  D,  respectively)  would  upwardly  adjust  the 
.1  .  1 


p  from  j- 


to 


This,  in  turn,  using  the  original 


,66*,  179  3,807  * 

study  methodology  would  change  both  u  and  from  ^ — r—  to  .  It 
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appears  that  this  aspect  of  the  critique  focuses  on  possible  changes 
in  vi  and  not  on  the  methodology  for  obtaining  Pc  from  y .  Based  on 
a  consistency  analysis  (employing  (2.6))  for  Pc  =  j  ^ ^  ,  we  can 
see  that  any  p  in  the  interval  ( ^  ^  ,  j^-g)  could  give  rise  to  the 

noted  Pc  of  j through  use  of  alternative  probability  models. 
Clearly  u  =  falls  in  this  interval,  '’’his  analysis  then  suggests 

that  model  selection  (or  equivalently,  as  discussed  in  Section  3, 
the  decision  maker's  viewpoint)  is  at  least  as  important  as  obtain¬ 
ing  an  expert's  judgment  that  is  reliable. 


2. 4  Risk  Determination  and  the  Decision  Maker's  Viewpoint 
As  discussed,  the  various  bounds  presented  will  in 
some  cases  unequivocally  decide  the  issue  of  acceptable  risk.  How¬ 
ever,  when  the  range  of  uncertainty  in  true  Pc  given  by  (2.4)  covers 
the  threshold  value  PT ,  we  must  look  to  a  more  detailed  model  to 
arrive  at  a  risk  determination.  The  expert  judgment,  u ,  cannot  by 
itself  resolve  the  issue,  and  it  is  at  this  point  that  the  viewpoint 
of  the  decision  maker  must  be  taken  into  account.  The  decision 
maker  retains  ultimate  responsibility  and  is  not  allowed  the  luxury 
of  being  noncommittal.  We  model  his  viewpoint  about  the  number  of 
potential  occurrences  of  E  by  his  assessment  of  the  probability  dis¬ 
tribution  governing  X.  The  decision  maker's  viewpoint  will  accord¬ 
ingly  be  represented  by  a  (M+l) -vector  p  where  p.  equals  the  decision 

% 

maker's  probability  that  there  will  be  i  occurrences  of  E.  Simple 
and  effective  procedures  for  eliciting  such  subjective  probability 
distributions  exist  and  are  well  documented  in  the  literature  (see 
Raiffa  (1968)).  The  viewpoint  of  the  decision  maker  thus  elicited 


n 

a  r,  fo  the  ornlvib  i  1  i  tv  d  i  s  t  r  i  bti  t  i  on  of  X  will  not-  in  general  be  con- 
.•'.istont  with  export  judgment  as  1-0  the  mn.in  <>i  V. 

3.  AN  INFORMATION  TUFORNTrc  MOON  i . 


3.1  fonnral  Model 

The  drnj.ni.on  maker  initially  holds  to  a  fixed  viewpoint  concern¬ 
ing  the  likelihoods  of  the  number  of  catastrophes .  This  viewpoint  is 
expressed  as  the  probability  vector  p  governi  ng  the  random  variable 
X.  However,  given  expert,  judgment  that  the  mean  of  X  is  ii ,  the 
decision  maker  is  compelled  to  adjust  his  vievrioi.pt  so  as  to  be  con¬ 
sistent  with  expert  judoment.  This  adjustment  process  can  bo 
expected  to  result  in  a  now  viewpoint  as  ''close*"  as  possible  to  the 
initial  viewpoint,  of  the  decision  maker  and  yet.  consistent  wi  Hi  tv. 
expert.  There  is  a  natural  probabj  1  i  st.i  c  eeometrv  in  vhirh  this 
process  can  be  embedded.  Tpe  expert’s  judgment  is  modeled  as  a 
linear  rubspaco  of  the  M-dimons  .i  onal  f  jppl  nv  nr  probabi.  3  i  tv  distri¬ 
butions  ,  namely 


(3.1) 


M  M 

n„)  :  >.  in.  ~  ii,  O .  -  1  .  and  n.  '■  0. 

M  i  .  ’  i 

j^-n  i^-n 

i  -V . Ml. 


The  decision  maker's  viewpoint  modeled  as  p  =  (pn»  .  p^,)  ,  where 

a, 

p.  -  Prob(x  =  i),  is  also  a  point  in  the  M-di monsi ona 1  simplex,  but 


is  not  in  general  a  point  in  S  .  The  adjustment  process  is  viewed 
as  finding  the  adjusted  decision  maker's  viewpoint  p^  -  (p^,  . 

p  ),  whore  p  r.  S  and  the  "distance"  from  p  to  p^  is  minimised. 


Note  that  the  probability  of  a  catastrophic  event  based  upon  moraine 


the  decision  maker's  viewpoint  and  the  expert  judnmr nt  is 
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Prior  to  having  the  expert  judgment  available,  the  decision  maker's 

"initial  assessment"  of  P  was  1  -  p_. 

c 

It  is  illustrative  to  examine  this  in  the  simple  case  when  M 
=  2  using  baricentric  coordinates. 

Figure  3.1 

Adjusting  Viewpoints  Based  Upon  Expert  Judgment  (M  =  2) 


(1.0,0) 


Based  upon  the  initial  viewpoint  of  the  decision  maker,  there  is 
an  initial  value  of  Pc.  By  "moving"  the  decision  maker's  viewpoint 
as  little  as  possible  and  yet  conforming  with  expert  judgment,  an 

adjusted  viewpoint  p  is  obtained  with  the  corresponding  "new" 

% 

value  for  P  . 

c 

Within  the  statistical  literature  there  are  a  number  of  possible 
measures  for  distances  between  probability  vectors  (e.g.,  Rao  (1965, 
pp.  288-289) ) .  One  measure  of  closeness  that  has  been  widely  employed 

is  the  Kullback-Liebler  discriminator  I(a;b)  between  two  probability 

%  a, 

vectors  a  =  (a^,  ...,  a  )  and  b  =  (b^,  . b  ) ,  where 
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-1 

(l.d  T  (n;b)  =  >:  a.?n(a.b.  ) 

m  -v  i-'fl  1  11 

Formally,  therefore,  the  process  of  finding  the  adjusted  viewpoint 

o 4-1io  do  err.  ion  maker  would  bn  equivalent  to  minimizng  I(q;p)  over 

A  r.  m 

q  c  P  and  takine  p  as  that  (unique)  minimi  z.mq  value  of  q.  The 
a.  1  «.  r. 

properties  of  the  Kullback-Lieblor  di scrimi.nator  are  extensively 

presented  in  T'ullhack  (1959),  and  Gokhnlo  and  Kullbaek  (197R).  Akaike 
(1977)  discusses  uses  of  the  Kullbae,-  -T.eibler  di  reriminator  in  a 
number  of  areas  of  statistical  inference.  For  a  review  of  other 
appl ications ,  see  Pampson  and  Smith  (19791. 

There  is  a  considerable  literature  on  this,  tvpe  of  adjustment 
process  viewed  in  the  context  of  generating  prior  probe  hi  lit.y  distri¬ 
butions  for  Payer- inn  inference.  An  axi  omat.i  ration  of  '-hi  r.  process 
toaot.be  r  with  an  extensive  discussion  of  the  1  i  tern  turn  can  be 
found  in  Pho.ro  and  Johnson  (19901  .  They  demons t.rn to  that  ’  ^ 
use  of  any  separator  other  than  (?■.?)  (which  •’•hoy  refer  '-o  rr 
cross-entropy)  for  inductive  inference  when  pew  in  forma  hi on  - r  in 
the  form  of  expected  valuer  loads  to  a  violation  of  one  on  ->a’-o 
reasonable  consist.encv  axioms. 

This  adjustment,  process  has  the  following  in torpre t.at.i  on .  Tto 
conventional  Shannon. -Wiener  (19^0'  entropy  measure  of  a  di  scry  to 

M  i 

probability  distribution  pis  gi  ven  bv  rfp!  -  f.  p.  F.np.  ‘  .  P(p'  cm 

a-  m  i~  P  n- 

be  intuitively  viewed  as  the  expected  "surprise"  (see  Tbei  1  (?°C'7i  ) 

associated,  with  p  where  In  p.'1  would,  be  the  "surprise"  generated  by 
a.  3  P  "  _  7 

the  occurrence  of  event  i.  Hc-writing  T  (g,p)  »  -f  S  g .  ( p.ng .  *  - 

1  m  a,  i  r-  p  ' 

?,np. '  )],  we  may  interpret.  J(q,p)  as  the  negative  of  the  expected  di  f f- 
erence  in  surprise  between  viewpoints  p  versus  q  if  in  fact  the  true 
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probability  distribution  is  q.  There  is  accordingly  an  inherent 
asymmetry  between  p  and  q  in  the  separation  measure  I(p,q)  where 

%  <\,  %  'V 

q  assumes  the  role  of  the  "true"  probability  distribution. 

Note  that  this  interpretation  supports  the  approach  of  choosing  an 

adjusted  viewpoint  from  those  q  consistent  with  expert  judgment 

% 

which  moreover  minimizes  I(q,p),  i.e.,  that  q  generates  the  least 

a,  'V  a. 

expected  difference  in  surprise  over  the  initial  viewpoint  p. 

r\j 

Sampson  and  Smith  have  applied  this  model  to  the  criminalistic 
problem  of  assessing  the  weight  of  circumstantial  evidence  linking 
a  suspect  with  the  perpetrator  of  a  crime.  A  number  of  results 
obtained  there  are  also  relevant  to  our  problem  of  assessing  P  . 

We  now  paraphrase  and  summarize  these  results  in  the  risk  determina 
tion  context;  for  a  formal  treatment  see  Sampson  and  Smith. 

Definition  3.1.  A  family  of  distributions  p(i,T),  -<*>  <  T  <  on 
the  integers  0,  . . . ,  M  is  a  finite  exponential  family  of  distribu¬ 
tions  with  parameter  t,  if  for  every  t 

p(i,T)  =  c(T)hieT1,  i  =  0,  ...,  M, 

M  t  •  _i 

where  h  =  h.  =1,  h  >  0,  ...,  h  >  0,  and  c(t)  -  (  E  h.e  3) 
u  ^  ”  j=0  3 

(Choosing  h^  *  h^  =  1  basically  fixes  scale  and  location  origins 

for  the  family.) 

Result  3.1.  (a)  Every  probability  distribution  p  =  (p0>  ...»  PM) 

on  0,  M  with  Pj,  >  0  belongs  to  exactly  one  finite  exponential 

family  of  distributions. 

(b)  Within  a  given  finite  exponential  family  of  dis¬ 
tributions  every  member  distribution  is  uniquely  indexed  by  the 

M 

parameter  T  and  also  by  p(T)  =  I  [i  c(T)h.eT1]. 

i=0  1 
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Thus  every  finite  exponential  family  of  distributions  can  be 
viewed  as  a  one-dimensional  curve  in  the  M-dimensional  simplex  of 
probability  distributions.  These  curves  never  intersect  and  are 
also  space  filling  in  the  sense  that  every  point  in  the  interior 
of  the  simplex  lies  on  exactly  one  such  curve. 

Consider  the  decision  maker's  viewpoint  p  =  (p0,  . PM) . 

a, 

By  Result  3.1  (a),  there  is  a  unique  finite  exponential  family 
•  t  i 

cMx)h£eT1,  <  x  <  °°,  such  that  p^  =  cMr^h^e  0  ,  i  =  0,  ...,  M; 

i.e.,  p  is  that  point  on  the  curve  indexed  by  x  =  xn. 

Result  3.2.  Based  upon  the  expert  judgment  that  EX  =  y,  the  adjusted 

A  t  i 

viewpoint  p  can  be  found  by  choosing  that  member  of  c*(x)h*e  , 

'v  M  1 

such  that  E  [i  c*(x)h*eT1]  =  y . 

i=°  1  A 

Intuitively  Result  3.2  states  that  p  can  be  found  by  tracing 

% 

the  finite  exponential  family  distribution  curve  containing  p  until 

'V. 

that  curve  intersects  .  Specifically,  the  point  of  intersection 
A 

is  p  . 

Again  it  is  illustrative  to  examine  the  probabilistic  geometry 
for  the  case  M  =  2,  using  baricentric  coordinates. 

Figure  3.2 

Finding  Adjusted  Viewpoints  (M  =  2) 

(1,0,0) 


■JaH M 


1 
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It  is  direct  to  show  that  (a)  lim  c(T)h.eT1  =1,  if  i  =  0, 

I  -V  —  OO 

T  1 

and  =  0,  otherwise;  (b)  lim  c(T)h.e  =0,  if  i  <  M,  and  =  1,  if 

-[■->00  ^ 

i  =  M.  Thus  in  terms  of  Figure  3.2  as  x  varies  from  to  °°,  the 
corresponding  point  on  the  finite  exponential  family  curve  traverses 
from  top  to  lower  right  bottom.  It  is  visually  obvious  and 
analytically  easy  to  show  that  Pc  is  monotone  increasing  in  i.  In 
fact,  however,  a  stronger  result  may  be  stated.  Let  F(k,x)  = 

Z  c(i)h.e  be  the  c.d.f.  of  the  number  of  catastrophic  events  at 
i£k  1 

the  M  sites.  Then  in  Appendix  B,  we  show  that  for  all  k,  F(k,r)  is 
decreasing  in  increasing  t.  This  is  equivalent  to  saying  that  the 
probability  of  more  than  k  catastrophes  increases  as  i  increases  and 
decreases  as  t  decreases.  Thus  two  different  probability  vectors 
on  the  same  finite  exponential  family  curve  represent  two  stochasti¬ 
cally  ordered  views  of  the  likelihoods  of  catastrophic  events,  with 
the  viewpoint  for  a  smaller  t  corresponding  to  a  belief  that  the 
likelihood  of  k  or  less  catastrophic  events  is  larger  than  for  a 
viewpoint  with  a  larger  t.  Also  in  Appendix  B,  wo  show  that  the 
mapping  taking  the  initial  decision  maker's  viewpoint  p  to  the 
adjusted  viewpoint  p  is  continuous  so  that  small  variations 
in  the  initial  viewpoint  lead  to  small  variations  in  the  adjusted 
viewpoint. 

Clearly  within  the  model  the  determination  of  Pc  is  dependent 
upon  the  value  of  p .  However,  it  is  reasonable  to  expect  that 
as  the  expert  judgment  becomes  compelling  concerning  the  unlikelihood 
of  a  catastrophic  event,  that  is,  as  u  0,  one  would  find  that  the 
initial  decision  maker's  viewpoint  becomes  increasingly  less  impor¬ 
tant  in  determining  Pc>  As  noted  in  (2.4)  ,  a  priori  bounds  for  Pc 
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are  M  ^p  £  Pc  £  p.  In  fact  for  M  =  2  these  bounds  correspond  in 
Figure  3.2  to  the  values  of  Pc  determined,  respectively,  by  the 
points  where  the  "right-hand"  and  "left-hand"  sides  of  intersect 
the  boundary  of  the  simplex.  Thus,  as  p  0,  these  bounds  converge 

fch 

to  0,  demonstrating  0 —  order  agreement  in  Pc  based  upon  different 

viewpoints.  More  importantly,  Sampson  and  Smith  show  that  this 
•  s  t 

model  provides  1 —  order  agreement. 


Result  3.3.  Let  p1  and  p  be  two  different  viewpoints  and  denote 
1  2  %  ^ 

by  Pc(p)  and  Pc(p),  the  respective  probabilities  of  a  catastrophic 

1  ? 

event  based  upon  expert  judgment  that  EX  =  p.  Then  Pc(v)  =  P^(p)  + 
o(p)  =  p  +  o(p),  where  lim  =  o. 

p-*0  W 

3 . 2  Risk  Determination  for  LNG  Tanker  Movement 

The  focus  in  this  case  is  on  obtaining  the  probability  of  one 
or  more  LNG  tanker  spills  in  the  New  York  harbor  over  a  10  year 
horizon.  The  generic  term  "site"  in  this  context  becomes  tanker 
trip,  while  "catastrophic  event"  corresponds  to  an  LNG  spill.  The 
expert  judgment  based  on  the  Federal  Power  Commissions  report  is 
that  there  is  an  expected  total  number  of  LNG  spills  of  p  =  ^ .  ■  - 


with  a  probability  of  a  spill  on  any  one  tanker  trip  of  4  5^4  ]7g 
(from  Table  1) .  With  a  total  of  M  =  1245  trips  over  the  10  year 
horizon,  inequality  (2.4)  provides  upper  and  lower  bounds  on  the 
probability  of  one  or  more  LNG  spills  Pc  as 


2.4 


10~7  <  P 


<  2.67  x  10 


-4 


That  is,  each  of  the  probabilities  in  this  interval  of  values  is 
consistent  with  the  FPC  report.  However,  because  of  the  small 
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magnitude  of  these  bounds,  the  first  order  approximation  provided 

-4 

by  Result  3.3  is  appropriate  in  suggesting  the  value  Pc  =  2.67  x  10 

Note  that  this  figure  is  in  agreement  with  that  arrived  at  by  the 

s  t 

FPC .  Moreover,  this  value  represents  Pc  to  1 —  order  regardless 
of  the  initial  viewpoint.  Thus,  two  decision  makers  with  differing 
points  of  view  when  presented  with  y  =  —  would  agree  based 

s  t 

upon  the  model  that  the  given  figure  for  Pc  is  correct  to  the  1 — 
order. 

In  order  to  illustrate  the  actual  adjustment  process,  suppose 

the  decision  maker's  viewpoint  can  be  modeled  as  p  =  (.99,  .009, 

<v. 

.0009,  .00009,  .00001,  0.,  ...,  0.).  Thus  the  decision  maker 

initially  believes  that  the  probability  of  catastrophe  is  .01. 

Based  upon  expert  judgment  that  y  =  ^  =  .0002669,  the  adjusted 

viewpoint  is  pA  =  (.999742,  .26  x  10_3,  .75  x  10_6,  .22  x  10~8, 

-11  ^ 

.70  x  10  ,  0.,  ...,  0.).  Hence,  based  upon  the  given  FPC  judgment 

for  y  and  the  decision  maker's  hypothetical  viewpoint  p,  the  proba- 
bility  of  one  or  more  LNG  spills  in  1245  trips  is  1.  -  .999742  = 

2.574  x  10-4. 

4.  MULTIPLE  EXPERT  JUDGMENTS 
4. 1  Updating  and  Merging 

Up  to  this  point,  we  have  considered  the  case  where  there  is 
just  one  expert  judgment  available.  Now  suppose  that  two  judgments 
are  available  to  the  decision  maker.  There  appears  to  be  two  basic 
situations  in  this  case.  One  is  where  both  experts  are  coequal  and 
their  judgments  are  to  be  equally  and  simultaneously  assimilated  by 
the  decision  maker  in  the  process  of  adjusting  his  initial  viewpoint. 
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The  other  basic  situation  is  where  the  decision  maker  adjusts  his 
viewpoint  in  light  of  a  first  expert's  judgment  and  later  is  con¬ 
fronted  with  an  updated  expert  judgment  to  which  he  must  readjust 
accordingly.  The  latter  situation  is  considered  first. 

Sampson  and  Smith  noted  that  there  are  two  ways  to  readjust 
the  decision  maker's  viewpoint  in  light  of  a  superseding  expert 
judgment.  One  approach  is  to  discard  the  viewpoint  adjusted  to  the 
first  expert's  judgment  and  return  to  the  initial  viewpoint;  then 
the  decision  maker  adjusts  in  the  usual  fashion  to  the  second  expert 
judgment.  The  other  approach  is  for  the  decision  maker  to  act  as 
if  the  viewpoint  adjusted  to  the  first  expert  judgment  is  the  new 
initial  decision  maker's  viewpoint;  then  the  decision  maker  would 
adjust  the  new  viewpoint  to  take  into  account  the  second  and  super¬ 
seding  expert  judgment.  Sampson  and  Smith  show  that  based  upon  the 
model,  both  of  these  two  noted  approaches  are  equivalent. 

Now  suppose  that  two  coequal  experts  provide  judgments  y^  and 
^2  where  it  is  assumed  that  y^  <  y ^ .  Based  on  his  viewpoint,  the 
decision  maker  must  simultaneously  merge  both  experts'  judgments  in 
obtaining  the  adjusted  viewpoint. 

A  A 

Denote  the  decision  maker's  viewpoint  by  p  and  let  p.  and  p9 

%  'vJ  a/' 

be  the  two  possible  adjusted  viewpoints  corresponding  to  y^  and  y2, 
respectively.  Let  p*  denote  the  decision  maker's  adjusted  viewpoint 
where  the  decision  maker  in  arriving  at  that  viewpoint  must  merge 
the  two  experts’  judgments  y^  and  y ^ •  Within  the  context  of  the 
model  and  under  the  assumption  of  coequal  experts,  we  require 

I (p* ;p^)  =  I (p* ;pj) , 

'X)  'V  Oj  'Xj 
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that  is,  the  decision  maker  adopts  an  adjusted  viewpoint  which  is 
equally  separated  from  the  viewpoints  that  would  be  taken  based  on 

each  expert  separately.  Roughly  speaking,  p*  is  "informationally 

A  A  ^ 

equidistant"  from  p^  and  p^. 

Writing  p  in  its  finite  exponential  family  form  f(i,r  ),  where 

^  xi  A 

f(i,x)  =  c(x)h.e  ,  we  can  by  Results  3.1  and  3.2  represent  p_.  by 

-1-  m 

f(i,T.),  j  =  1,  2,  where  x.  <  x_.  Let  p(x)  -  Z  if(i,x).  Without 
3  i— 0 

any  further  constraints  on  p*,  it  is  shown  in  Lemma  C.l  (Appendix 

% 

C)  that  any  p*  =  (p*,  .  ..,  p*)  satisfying 
M 

(4.1)  Z  i  p*  =  E ( u (T) ) , 

i=0  1 

where  T  is  a  random  variable  with  uniform  distribution  on  (x^x,,), 
is  "  informational  ly  equidistant"  from  p^1  and  p^ .  Another  way  of 

'V  <v 

viewing  (4.1)  is  that  F(p(T))  is  the  merged  value  of  and  p  as 

seen  by  the  decision  maker  with  viewpoint  p.  Note  that  the  merged 

% 

value  of  Pj  and  p2  is  dependent  upon  the  specific  viewpoint  of  the 
decision  maker. 

However,  within  the  context  of  the  model,  it  is  required  that 

p*  be  as  informationally  close  as  possible  to  p.  Specifically,  we 

^  A  ^ 

require  that  p*  minimize  T(p*;p)  subject  to  T(p*;p.,)  =  J(p*;p'_,). 

*1/  'v  a*  ^  0/ '  'v- 

In  Lemma  C.2  (Appendix  C) ,  it  is  shown  that  p*  is  given  by  f(i,x*), 

a. 

where  x*  is  determined  uniquely  by 

(4.2)  p(x*)  =  E(p(T) ) , 


where  T  has  a  uniform  distribution  on  (x^,x2).  A  graphical  pre¬ 
sentation  of  this  process  employing  baricentric  coordinates  for 
the  M  =  2  case  is  given  in  Figure  4.1;  and  in  Figure  4.2,  wo  view 
the  process  for  a  general  distribution  graphing  p(x)  versus  x. 


r 
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Intuitively,  the  result  of  (4.2)  says  that  the  way  to  merge 
vi^  and  is  to  average  the  intermediate  means  by  weighting  them 
uniformly  with  respect  to  t  along  the  finite  exponential  family 


curve  containing  p.  Clearly  this  is  different  than  weighting  uni- 

o. 

formly  with  respect  to  the  means  themselves?  such  an  approach  would 
yield  (y^  +  y2) /2  as  a  merged  opinion.  More  specifically,  from 
Figure  4.2  and  (4.2),  we  are  able  to  see  that  x*  is  chosen  so  that 
the  shaded  area  under  the  y(x)  function  is  equal  in  area  to  a  rect¬ 
angle  whose  sides  are  of  length  t 2  -  x^  and  y(x*).  Moreover, 
depending  on  where  x-^  and  x^  are  located  relative  to  the  curvature 
of  y(x),  y(x*)  may  be  closer  to  y^  or  to  y_.  In  the  case  where  x^ 
is  "moderate"  and  x^  is  "small,"  y(x*)  tends  to  be  closer  to  y^ 
than  to  y^. 

The  actual  evaluation  requires  first  obtaining  x ^  and  x^  cor- 
A  A 

responding  to  p-j  and  p2,  respectively.  (Several  techniques  for  this 

%  '  O' 

are  discussed  in  Section  5.)  Then  it  can  be  shown  (see  Appendix  C) 


that 


M 

t2  /  .  1  j  (Pf/Pl5  1PieS1\ 

(x*)  =  -(x2-x1)"1/  U-f - : - r)ds, 

_  '  i  si/ 


i  E  (Pn/P-|)  P,e‘ 
i=0  U 


where  p  =  (p^,  p^,  ...,  p^)  is  the  decision  maker's  viewpoint. 


4 . 2  Binomial  Viewpoints  and  Rare  Expert  Judgments 

Two  special  cases  for  merging  are  worth  considering  further. 

One  is  where  the  decision  maker  has  a  binomial  viewpoint  and  the 

other  is  where  y^  and  y2  are  small.  Suppose  that  for  some  it,  p^. 
Mi  M-i 

is  given  by  ( ^ )  7T  (1-tt)  ,  i  =  0,  ...,  M,  and  the  two  experts' 

judgments  are  y^  and  y  .  In  Appendix  C,  it  is  shown  that  y*,  the 


merged  judgment  from  the  decision  maker's  viewpoint,  can  be  explic¬ 


itly  stated  in  terms  of  p^,  p2,  an<3  M,  as  follows: 

M  -  p  p2  M  -  p..  1 

p*  =  M  Hn  [— - ±]Un[—  •  - - -1)  . 

LM  -  p  1  lPj  M  -  P?  1 


In  the  second  interesting  case,  we  suppose  that  the  expert  judgments 
p^  and  p2  are  quite  small.  For  this  case,  it  can  be  shown  (see 
Appendix  C)  that 


(4.3)  p*  =  (p2  -  p^/tfcn  p2  -  In  p^  +  o(max(p1,p2) )  . 


Incidentally,  if  the  decision  maker  were  allowed  to  have  a  Poisson 

viewpoint,  the  exact  value  for  p*  would  be  (p2  -  P1)/(£np2  -  Jlnp^)  . 

Note  that  if  instead  we  are  dealing  with  p*  =  p*/M,  =  p-^/M,  and 

(2) 

p  =  p2/M,  then  (4.3)  can  be  re-expressed  as 

(4.4)  p*  «  (p(2)  -  p(1) )  /  ( S,n  p(2)  -  Jin  p(1))  . 

"V1  _v2 

Now  suppose  p^  =  10  and  p2  =  10  ,  where  v1  is  substantially 

larger  than  v2;  then  from  (4.3),  it  follows  that  p*  can  be  approxi¬ 


mated  by  10 


-(V2+1°^10V1) 


4. 3  Applications  of  Merging  Judgments 

The  result  of  (4.4)  can  be  used  to  merge  rare  probability  judg¬ 
ments  concerning  SCRAM  failures  in  nuclear  reactors.  The  SCRAM  system 
in  boiling-water  reactors  is  a  system  whereby  the  nuclear  chain 
reaction  in  a  reactor  can  be  stopped  quickly.  In  the  Rasmussen 
report,  the  probability  of  a  SCRAM  failure  was  assessed.  Lewis 
writes 
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"The  problem  encountered  in  estimating  this  probability 
is  that  the  SCRAM  systems  are  so  important  and  so  well 
designed  that  the  event  in  question  (SCRAM  failure  on 
demand)  has  never  happened  and  therefore  there  is  no 
basis  in  experience  from  which  to  assess  the  reliability 
of  this  system." 

Based  on  two  different  sets  of  assumptions,  the  Rasmussen  report 

presented  two  distinctly  different  probabilities  that  a  typical 

SCRAM  operation  fails,  namely  p^  =  10-12  and  p^  =  10_(\  In  an 

attempt  to  combine  these  rare  judgment  probabilities,  the  geometric 
-9 

average  of  10  was  employed  by  the  Rasmussen  report.  This  proce¬ 
dure  for  combining  these  judgments  prompted  Lewis  to  comment  "there 
may  somewhere  be  a  statistician  who  believes  that  this  is  a  valid 
procedure  but  he  has  yet  to  make  himself  known."  An  application 
of  (4.4)  to  p^  =  10  and  p^  =  10  ^  suggests  that  the  combined 

-7 

p*  should  be  1.67  x  10  which  is  a  couple  of  orders  of  magnitude 
less  conservative  than  the  Rasmussen  report  value  of  10-?.  Note 
that  in  the  case  of  rare  expert  judgments,  the  value  of  p*  essen¬ 
tially  does  not  depend  on  the  decision  maker's  viewpoint. 

Another  application  of  (4.3)  is  to  merging  judgments  concerning 
the  seismic  safety  of  nuclear  reactors  in  Case  Study  2.  In  this 
case,  Pc  becomes  the  probability  of  one  or  more  reactor  meltdowns 
during  a  given  year.  The  sites  are  literally  light  water  nuclear 
reactors.  The  expert  judgment  in  this  case  flows  from  two  distinct 
sources.  The  NRC  report  placed  the  mean  number  of  meltdowns  over 

-5 

the  M  =  100  reactor  sites  at  a  value  of  y^  =  4.7  x  10  .  On  the 
other  hand,  the  Okrent  study  assessed  the  figure  at  ^  =  8  x  10 
Noting  that  these  figures  are  sufficiently  small  so  as  to  justify 
use  of  a  first  order  approximation,  we  can  merge  the  two  expert 
judgments  according  to  (4.3),  obtaining  y*  =  1.55  x  10  Note 
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that  the  effect  of  the  adjustment  process  is  to  give  greater  weight 
to  the  more  conservative  figure  corresponding  to  the  judgment  of 
the  Okrent  study.  The  ultimate  probability  figure  for  Pc  will 
depend  on  the  initial  viewpoint  of  the  decision  maker.  Again,  how¬ 
ever,  to  first  order,  the  merged  value  for  the  probability  of  one 
or  more  reactor  meltdowns  due  to  severe  seismic  activity  is 

P  *  1.55  x  lO-3. 
c 


5.  COMPUTATIONAL  CONSIDERATIONS 
Brockett,  Charnes  and  Cooper  (1978)  have  in  essence  shown  that 
the  actual  derivation  of  pA  from  p  and  p  can  be  viewed  as  an  uncon- 

'X/  >x. 

strained  convex  programming  problem.  Consequently,  standard  computer 
packages  can  be  employed.  Other  mathematical  techniques  that  can 
be  used  in  the  constrained  Kullback-Leibler  discrimination  minimiza¬ 
tion  problem  can  be  found  in  Kullback  and  Gokhale.  In  Appendix  D, 
we  give  the  details  for  an  IMSL  (1979)  implementation  of  the  Brockett 
et  al  technique. 

Another  approach  that  could  be  used  to  finding  p  is  described 
in  Lemma  D.l  (Appendix  D) .  Let  m(s)  be  the  moment  generating  func¬ 
tion  determined  by  the  decision  maker's  viewpoint  probabilities, 

M  si 

i.e.,  m(s)  =  T.  e  p..  Let  sn  be  the  unique  solution  to 
i=0  1  u 

m' (s)  -  pm(s)  =  0  ; 


th  A 

then  the  i  entry  of  p  is  given  by 


-1 


.  trti  M  . 
i  0  ,  „  -1 


j  V 


po  pi(p0/pi}  e  (.^0p0  pj(po/pi)  e  >' 

where  tq  =  sQ  -  *.n(pQ/p1). 


7.1 


6 .  DISCUSSION  AND  SUMMARY 

In  this  paper  we  have  presented  an  information  theoretic  model 
that  provides  a  minimum  bias  approach  for  the  merging  of  expert 
judgment  and  decision  maker's  opinion  as  to  the  likelihood  of  rare, 
but  catastrophic  events.  In  particular,  the  decision  maker  expresses 
his  viewpoint  concerning  the  probabilities  of  various  numbers  of 
catastrophic  event  occurrences  across  a  number  of  sites,  and  the 
expert  provides  his  judgment  concerning  the  likelihood  of  a  cata¬ 
strophic  event  occuring  at  a  typical  site.  When  the  expert's  judg¬ 
ment  is  that  the  likelihood  of  a  catastrophe  at  a  typical  site  is 
remote,  we  show  that  decision  makers,  with  different  viewpoints, 

S  t" 

would  still  agree  (to  1 — -  order)  concerning  the  probability  of 
catastrophe. 

Using  the  basic  model,  we  have  developed  meaningful  and  objec¬ 
tive  methods  to  merge  and  to  update  judgments  from  more  than  one 
expert.  Approximations  are  given  for  merging  of  two  expert  judg¬ 
ments  when  the  judgments  indicate  the  probabilities  of  catastrophes 
are  very  small.  The  results  for  this  rare  event  merging  are  inde¬ 
pendent  of  the  decision  maker's  initial  viewpoint. 

Several  computational  approaches  suitable  for  computer  imple¬ 
mentation  are  discussed. 

Lewis  wrote  concerning  "the  importance  to  society  of  assessing 
risk  in  quantitative  terms  and.  of  making  sound  interpretations  of 
those  risks."  We  believe  that  our  modelling  approach  provides  an 


important  step  toward  attaining  this  important  societal  goal. 
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Appendix  A 

SITE  DEPENDENCIES  AND  PROBABILITY  BOUNDS 

A.  1  Dependencies  Across  Sites 

We  discuss  here  the  relationship  between  dependencies  among 
random  variables  versus  independent  random  variables  sharing  an 
unknown  but  common  parameter.  Parameter  here  may  represent  design 
commonality,  component  commonality  or  operating  system  commonality. 

In  particular  consider  the  random  variables  ...» 

serving  as  indicators  for  occurrence  or  non-occurrence  of  cata¬ 
strophic  events  over  the  M  sites.  Suppose  all  failures  at  these 
sites  share  a  common  component  type  and  manufacturer.  Let  q  repre¬ 
sent  the  probability  that  the  design  of  that  component  type  by  that 
manufacturer  is  defective.  Then  q  =  P  (Y  =  1),  where  Y  =  1,  or  0, 
respectively,  if  the  design  is  defective,  or  not.  Now  suppose 

,  it  .  for  y  =  1 
P(Yi  =  1|Y  =  y)  =| 

it  I  for  y  =  0 , 
l 

where  ir  /  it j,  for  some  i.  An  expert  reliably  testifies  as  to  the 
likelihood  p  that  a  randomly  selected  site  would  experience  a  mal¬ 
function  over  the  horizon  time.  Then 

p  =  p(f  =  1 1 Y  =  1)  P  (Y  =  1)  +  P(T  =  1 1 Y  =  0)  P  (Y  =  0) 

.  M  .  M 

=  qM_1  T,  7T  .  +  (l-qjM*"1  T.  n  ! 

i=l  1  i=l  1 

where  I  is  the  index  of  a  randomly  selected  site. 

4. 

Lemma  A .  1 1  :  The  random  variables  H* ^ ...,  are  conditionally 

+  # 

We  assume  here  for  simplicity  that  the  component  of  interest  repre¬ 
sents  the  only  commonality  among  the  sites. 
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independent  qiven  Y. 

Proof;  Immediate. 

Lemma  A. 2:  The  random  variables  Y^,  ,  . ..,  YM  are  unconditionally 

dependent. 


Proof: 


Suppose  ^  f  tr|.  Then 


P(Y1  =  1 


Y2  =  D  = 


12 


V  + 


ir'iT*(l  -  q) 
"  *  Cr-~qT  ■ 


/  *jq  +  -  q)  =  p(i’1  =  i)  •  n 

Since  we  are  not  in  general  aware  of  the  value  of  Y,  i.e.,  whether 
or  not  a  design  error  has  been  made,  we  are  in  the  situation  of 
Lemma  A . 2 . 

The  above  analysis  can  be  easily  generalized  to  the  case  of 
multiple  common  components  or  subsystems  by  letting  Y  bo  a  binary 
vector  of  dimension  equal  to  the  number  of  distinct  shared  com¬ 
ponents.  Obviously  in  practice,  the  specification  of  a  complex 
system  in  this  fashion  is  essentially  impossible. 


A. 2  Bounds  for  Pc 

A  proof  of  the  upper  and  lower  bounds  of  (2.2)  for  the  general 
case  of  Y^,  Y2 ,  ...,  Y^  following  an  arbitrary  multivariate  distri¬ 
bution  follows. 


Theorem  A. 1:  Suppose  Y^,  Y2,  ...,  ym  are  zero-one  random  variables 

M 

with  it  =  Prob(Y.  =  1)  being  given.  Let  X  =  l  Y . ,  and  P  =  p(x  >  1)  . 

13.  i  ■  1  C 

1=1 


Then 


M 

max  it.  <  P  <  min(  T.  ir.,1). 
l<i<M  1  c  i=l  1 


(A.  1) 
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Moreover,  these  bounds  are  attainable,  whenever  EX  <  1. 


Proof;  Let  F^(t)  denote  the  joint  c.d.f.  of  4^,  ...,  4^,  where  the 
•  th  ,  _  %  _  _  . 

l  marginal  c.d.f.  is  FMt.^)  =  0,  for  t.^  <  0;  =  ,  for  0  £  t.  £  1 

and  =  1,  otherwise.  Then  for  all  t 

'V. 

M 

(A. 2)  max (0 ,  Z  F. (t.)  -  (M  -  1))  <  F  ft)  <  min  {F. (t.) }. 

i=l  1  1  l  l<i<M  1  1 

(See  Dall'Aglio.)  Note  that  P  =  1  -  F ^,  ( 0 )  r  so  that  (A. 2)  immedi- 

ately  implies  (A.l) .  The  attainment  of  the  lower  bound  of  (A.l) 

M 

follows  from  the  fact  that  min ’{F.(t.)>  is  a  c.d.f.  If  T.  ir.  £  1, 

l<i<M  1  1  i-1  1 

the  upper  bound  of  (A. 1)  is  attainable  because  the  lower  bound  of 

(A. 2)  is  itself  a  c.d.f.  (see  Dall'Aglio  or  Conway  (Theorem  5.2; 

1979)).  n 


Another  way  of  viewing  Theorem  A.l  is  to  define  4>^  =  {F  ft) : 

z  % 

for  all  i,  P  ( 4* .  =  1)  =  tt.  and  P(y.  =  0)  —  1  -  n.}.  Then  thinking 

^  1  j.  1 

of  P  as  a  function  of  F  ( t)  e  ,  (A.l)  provides  attainable  upper 

%  ^  1 

and  lower  bounds  on  Pc  as  F  ( t)  varies  over  Now  suppose  that 

*\j 

full  marginal  information  is  not  known  and  all  the  information  that 

-1  M 

is  available  is  M  T.  tk  =  p.  Define  <S>?  ~  (F^ft):  for  all  j, 

i=l  .  M  ^ 

P  ( 4*  =  0)  +  P  ( 4* ,  =  1)  =  1,  and  (M  )  Z  P(Y.  =  1)  =  p}.  Oearly 

i  x  •  ■*  i 

c  1=1 

*1  i  4>2*  Tlien  as  F  ( t)  ranges  over  4>»,  obtainable  upper  and  lower 

bounds  for  Pc  are  given  by  (2.3). 
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Appendix  B 

STOCHASTIC  ORDERING  AND  CONTINUITY  OF  ADJUSTMENT  PROCESS 


n . 1  Stochastic  Ordering  of  Exponential  Family  Distributions 
Definition  B.l  (E.g.,  Lehmann  (p.  73,  1959)).  A  family  of  cumula¬ 
tive  distribution  functions  (Ft>  is  stochastically  increasing 
(decreasing)  in  t  if  t  <  t'  implies  F^(x)  >_  (,<)  F^.fx)  for  all  x. 

It  follows  from  Lehmann  (1959;  Corollary  2,  p.  70  and  Lemma 

[x]  Ti 

2,  p.  74)  that  F  (x)  -  E  c(T)h.e  ,  x  £  M,  is  stochastically 

i=0  1 

increasing  in  t.  A  more  direct  proof  follows  below,  but  first  we 
require  a  simple  probability  lemma  of  interest  in  itself. 


Lemma  B . 1 .  Let  X  be  a  random  variable  taking  on  value  i  with  proba¬ 
bility  ,  where  i  =  0,  . . . ,  M.  Then  for  all  k, 

k 

(B.  3  )  (EX) (P(X  <  k) )  >  E  iw.  . 

"  i=0  3 

Proof:  For  any  k  _<  [EX],  where  (•]  denotes  the  greatest  integer 

k 

function,  we  have  E  (i  -  EXH).  5  0  so  that  (R.l)  is  immediate. 

1=0  3  kn 

Suppose  that  there  exists  k  >  FEYl  such  that  E  (i  -  EXi w .  >  0. 

°  i.-O  T 

Hox>'ever,  because 

M  ko  M 

0  =  E  (i  -  EX)  u.  =  E  (i  -  EX)  a).  +  E  (i  -  E(X))w., 

3=0  -  i  =0  •r  i=k  +1  1  - 

o 

we  obtain  an  immediate  contradiction  concerning  the  existence  of 

such  a  k  .  f- ’ 

o  1 

Theorem  B.l.  Let  p(i,x)  =  c(x)h.oT;i,  i.  =  0,  ...,  M  and  Jet  F(k,xl  = 
I: 

E  p(i,x).  Then  F(k,x)  ir  a  d^croasina  function  in  x  for  aJ  3  k  =  0, 
i-0 

. . - ,  M. 

Proof:  Note  that  si’-’co  p  < x )  -  -o' ( t)/c(x). 


dF (k , t) 
dT 


JV  •  fv 

l \  c,(T)h.eT  +  z  ic(T)h.eT1 

i“0  1  i“ 0  1 
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k 

=  -r  (EX)  (P(X  <  k))  -  T.  iP  ( X  -  i)  1  , 

.v  0 

where  X  is  a  random  variable  with  p.d.f.  p(i,-r).  The  result  is  now 
immediate  from  Lemma  B.l.  P] 


R. 2  Sensitivity  of  the  Adjusted  Viewpoint  to  Variation  in  the 
Initial  Viewpoint 

mhrerem  p.2.  For  every  0  £  vi  £  M,  the  function  faking  p  into  p 

A,  ^ 


Proof:  Let  {p,  }  be  a  seauenco  of  viewpoints  converging  to  the  view- 

K 

point  We  need  to  show  thel  limp  -  p  .  Jet  h  -  (h.,  ...»  h  ) 

define  (in  the  sense  of  Definition  3.1)  the  finite  exponential  family 


for  p  end  py\  and  Jet  xfl 

o ,  r\,  A , 

mo'-n’T.  Similarly  Define 

frpn  Damns  on  and  f  m’  '  J  P 

the-’-,  c  f  (h  )  ,  h  1  ~  o  for 

0.  *V 


e n a  t  >' iJ  No  the  nn-one  respective  para- 
h,_,  T  r  and  '-I,'.  Then  it  follows 

n.  v 

'T* .  Pn  mt  ion  rA  .?)  *  to  f  Jim  hv  —  h.  Note 

t-'o  S.'  S. 

aJ.J  1".  v’hero  we  dn't'-o  for  fired  ii 


m  m 

a  ( r .  M  —  j;  iIi.eT'  (  X  h  .  o  T  -1 1 
irl  -1  irO  ? 


V 


?  <- 


i  r 


a 

r-  rr"  >  0  (see  Sampson  and  Smith  On7?, 

con  ti nuour ,  it.  ’’el  lev’s  that,  r7  Mi)  is  a 

s. 


Fguati on  M .  3) ) 
eontinvous  func¬ 


tion  of  h  by  the  imnJicit  function  theorem  fe.r. r  PartJe  (J9G^;  p. 

s. 

J\  J\.  "f*  1 1 

2GP)  )  .  Donee,  J  im  t  fh,  )  =-  t  fh)  .  Denote  the  i  onJ-rv  nr  a  vector 

]"-vm  M,  M. 

JJ-  follow?  rrom  the  procor,?na  Vbp!" 


X  by  r(i. ). 
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A,  TA(h  (i)  )  M  TA{h.(j))  . 

lim  Pk(i)  =  lim  h  (i)e  K  (  I  h.  (j)e  k  )_i 

k->°°  k-*-°°  j — q  K 


=  h(i)eT  i  h(  j)exA(h(^  )  )_1 

j=0 


A 

=  p  (i),  for  all  i  =  0,  - -  M.  p 


Appendix  C 

MERGING  COEQUAL  EXPERT  JUDGMENTS 


C. 1  The  General  Case 

Lemma  C.l  describes  which  viewpoints  are  "informationally 
equidistant"  from  two  adjusted  viewpoints  determined  by  a  decision 
maker  from  two  coequal  expert  judgments.  Lemma  C.2  utilizes  Lemma 
C.l ‘to  choose  among  these  viewpoints  that  viewpoint  "closest"  to 
the  decision  maker’s  viewpoint. 


Lemma  C.l.  Suppose  that  p.  and  p„  are  given,  respectively,  by 

fdjt^)  and  f(i,T2),  where  x^  <  and  f(i,x)  =  cdJh^e11,  i  -  0, 

M 

...,  M.  Let  m(t)  =  £  if(i,T).  Then  a  necessary  and  sufficient 

i=0 

condition  that  p*  =  (p*,  ...,  p*)  satisfy  I(p*;p.)  =  I(p*;p„)  is 
M  'v  u  ”  -v  'v1  >\, 

that  E  ip?  =  E  ( ja  (T)  )  ,  where  T  is  a  random  variable  having  uniform 
i=0  1 

distribution  on  (x^ ,  t 2)  . 

Proof ;  If  I (p* ; p. )  =  I(p*;p_),  then 

'Xj  'VL  %  'XT 

M  p*  M  p* 

(C.l)  £  p*  £n(— i-)  =  £  p?  £n(— , 

i=0  1  pli  i=0  1  p2i 

where  p^,  p2i'  an<^  pi  are'  respectively  the  (i+l)st  entries  of 
p. ,  p_,  and  p* .  Equation  (C.l)  and  the  form  of  f(i,x)  imply 

'■ly1  rx,^  a. 

M  M 

£  p?[Hn  c(x.)  +  Jin  h,  +  x.i]  =  £  p?[Jln  c(x_)  +  Jin  h .  +  x-i], 

i=0  1  1  1  1  i=0  1  1 

which,  in  turn,  implies 

M  -1 

(C.2)  £  i  pt  =  -(to-t-i)  (Jin  c(i_)  -  Jin  c(x,))  . 

i=0  1  *  1  1  1 


By  differentiating  with  respect  to  x  the  equation 


35 


M 

£  c  ( x ) h . eT 1  =  1, 
i=0  1 

we  obtain 


(C . 3)  y(x)  =  - (dc (x) /dx) /c (x) , 


and,  hence,  from  (C.3),  we  may  represent 


(C.  4)  In  c(x)  =  -/T  p(s)ds  +  K, 


where  K  is  a  constant.  Substituting  (C.4)  into  (C.2) 

M  .  T- 

(C.  5)  £  i  p*t  =  (t2-t1)"x  f  m  (s)  ds, 

i=0  x^ 

and  the  result  now  follows. 


we  obtain 


n 


Lemma  C.2.  Suppose  that  p,  p^  and  p2  are  given,  respectively,  by 

'Xj  'X/  'X/  ^ 

f(i,xQ),  f(i,x1),  and  f(i,x2>,  where  x^  <  x2  and  f(i,x)  =  c(x)hie  , 

M 

i  =  0,  .  .  .  ,  M.  Let  )i  (x)  =  T.  i  f(i,x).  Then 

i=0 


min  I (q?  p) 

q:I  (g;p1)=I  (q;p2)  x,x, 

occurs  uniquely  at  q  =  p*,  where  p*  =  f(i,x*)  and  x*  is  determined 

x,  x,  x, 

by  u(x*)  =  E (y (T)  )  ,  where  T  is  a  random  variable  having  a  uniform 
distribution  on  (x^,x2). 

Proof:  This  follows  immediately  from  Lemma  C.l  and  Result  3.2.  [”1 

A  more  specific  representation  for  y(x*)  in  terms  of  the  deci¬ 
sion  maker's  viewpoint  can  be  obtained.  Let  p  =  (Pq»  .  ..,  PM)  be 
the  viewpoint  with  p^  >  0  and  p^  >  0.  Sampson  and  Smith  (1979, 

(4.2))  showed  that  the  finite  exponential  family  containing  p  can 

x, 

be  parametrized  by 
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(C. 6 )  f(i,x)  =  c (t) p~1pi (pQ/p1) 1eT1  , 

M 

where  c(x)  is  chosen  so  that  £  f(i,r)  =  1.  When  t  =  £n(p,/pn) , 

i=0 

f(i,r)  =  p^.  Again  noting  that  jj(t)  =  -c'(t)/c(t),  and  using 
(C.6),  we  can  rewrite  (C.5)  for  computational  purposes  as 


M 

£  i(p  /p  )xp  esl 
- 1  1 ?  i =n  u  i  i 

y  (x*)  =  ^  - )ds. 

T1  £  (p  /p  )1p  esl 
i=0  u  1  i 


C. 2  The  Binomial  Case 

Now  suppose  that  the  decision  maker  has  a  binomial  viewpoint, 

i .  e .  , 

(C .  7 )  pi  =  (i)ir  (1  -  it) 


Then  (C.7)  can  be  parametrized  as 


,  ,  .  \  Mx iT 

f  (i,t)  =  e  )e  , 


where  x  =  An  (it/ (1-ir)  )  .  If  we  parametrize  by  y  =  Mir,  then  x  = 
£n(y/(M  -  y)).  Suppose  that  we  have  two  expert  opinions  y-^  <  y0, 
with  corresponding  x^  <  x By  Lemma  C.l,  the  merged  opinion  y* 
is  given  by 


-  -  V-1 

x^  1  +  e 


ds 


=  M (x-  -  x 


)  1An[(l 


+  e  n/{l  +  e  )]. 


Substituting  in  terms  of 


y*  =  M  An[ 


M  -  y. 
M  -  y. 


yL,  y2. 


-]  ( An[- 


we  have 
M  -  y 


M  -  y 


hr1 


2 
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C. 3  Merging  Rare  Judgments 

We  now  consider  rare  judgment  approximations;  that  is,  the 
case  where  y^  and  y2  are  small.  Sampson  and  Smith  (1979,  Equation 
(5.2)  show  that 

(C.8)  y (t)  =  eT  +  e  (t) , 

where  lim  e(T)/y(t)  =  0. 

T-*-— oo 

Let  <  t2  correspond  to  expert  judgments  y^.  <  y2«  Then  by 
(C. 5)  and  (C.8), 


y*  =  a  +  8, 

T  T  T 

where  a  *  (t2-t^)  ^(e  ^  -  e  ^)  and  8  =  (t2~t^)  ^ 

T1 

Observe  that  e(s)  =  v(s)  -  es  is  the  difference  of  two  con¬ 
tinuous  functions  and  hence  is  also  continuous.  Therefore,  e(s) 

attains  its  maximum  value  over  [t-,,t2].  Let  e(tJ~)  =  max  e(t) 

1  i  Ti£T5To 

Then 

8  <_  (t2-t1)  ~1e  (t*2^t2-t1^  =  G^T12^' 

It  follows  that 

8  =  o(u2)  , 
because  as  t2  -<*> 


t2  e(t*  )  t2 
_8_  =  _8_  e_2  <  *t12*  e 

u2  t2  u2  ~  t12  y2 

e  e 


-*■  0,  as  y. 


0. 


Now,  by  (C.8),  y(r)/e  ■+■  1  as  t  ■+  and  since  r(y)  = 


y‘1(y) 


(see  Sampson  and  Smith  (1979,  Equation  (4.3))),  we  obtain  that 
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y/eT  ^  +  1  as  u  +  0,  which  implies  that  t(y)  =  itn  y  +  o(y).  Hence, 

_i  o(p9)  o(P-i) 

a  =  Un  y2  +  o(v>2)  -  fcn  y]L  -  ofy-^))”  (e  y2  -  e  y ^ )  . 


Note  that 


VU  -  P- 


_Lr _ 

P2  2-n  y2  -  £n  y^ 


o(P0) 

-  <*]  -  — rr^—l 


“ 2  '  "l 


y  u  2 

2  (£ny2  -  £nyj  1>  +o ( y 2>  ( £ny2-£ny 


0,  as  y 2  0, 


so  that  it  now  follows  that 


y*  = 


P2  -  Px 


£n  y 2  -  £n  yx  +  °{w2* 


39 


Appendix  D 

COMPUTING  P  BASED  UPON  V  AND  P 

'Xj  'V 


Brockett,  et  al  have  shown  that  the  problem  of  minimizing  the 
Kullback-Liebler  discrimination  subject  to  constraints  on  the  proba¬ 
bility  vector  obtained  can  be  re-expressed  as  an  unconstrained  con- 
vex  mathematical  program.  Specializing  their  results  to  our  case 
results  in  the  following  mathematical  program: 

iz. 


(P) 


z  ^  —  1  m  xu. 

Minimize  y  =  e  (  I  p.e  i)  -  uz.  -  z_ 
z1,z2  i=0  1 


Letting  the  solution  to  (P)  be  z^,  z*,  we  obtain 

A  i2i  +  z2- 1 

pi  =  pie  i  =  • • • *  M- 


The  program  (P)  may  be  quickly  and  easily  solved  by  any  unconstrained 
mathematical  programming  algorithm.  For  example,  IMSL  (International 
Mathematical  and  Statistical  Library)  has  a  FORTRAN  callable  sub¬ 
routine  ZXMIN  which  will  solve  (P)  after  defining  the  function  y 
as  a  user  supplied  FORTRAN  subroutine.  For  problems  where  a  large 
number  of  p^  are  positive  or  p  is  very  small  additional  care  must 
be  taken  to  avoid  computational  numerical  difficulties. 

Another  approach  to  computing  pA  makes  use  of  certain  rela¬ 
tionships  between  finite  exponential  families  containing  a  viewpoint 
p  and  the  moment  generating  function  corresponding  to  p.  Through 

^  A/ 

this  approach,  the  optimization  problem  becomes  one  of  finding  the 
unique  root  of  a  specific  equation.  One  of  the  benefits  of  this 
approach  is  that  for  small  M,  the  problem  can  be  solved  reasonably 
readily  on  a  programable  hand  calculator. 
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Lemma  D .  1 .  Suppose  p  =  (pQ,  pM) ,  pQ  >  0,  p^  >  0,  is  the 

'Xj 

decision  maker's  viewpoint  and  let  f(i,x),  given  by  (C.6)  be  the 
finite  exponential  family  containing  p.  Then  the  unique  x^  which 
satisfies  u(xQ)  =  is  xQ  =  sfl  -  £n(p0/p^),  where  sQ  is  the  solu¬ 
tion  to 

(C. 7)  m' (s)  -  y0m{s)  =  0, 

where  m(s)  is  the  moment  generating  function  of  p. 

% 

Proof :  The  equation  y(x)  =  can  be  rewritten  as 

,  M  . 

(C.8)  p“  E  i  p  (pn/p.)1eT1  =  vin  c(x)“ 

0  i=o  1  u  ±  u 

.  m  . 

■  vo?o  .yi'pc/ei1  e  • 

m 

T  1 

Since  m(x)  =  E  p.e  ,  (C.8)  can  be  rewritten  as 

i=0  1 

m'  (t  +  £n(pQ/p1))  =  p0m(T  +  £n(pQ/p1)) 
and  the  result  then  follows.  f""1 
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